Quality assessment of a large multi-center flow cytometric dataset of acute myeloid leukemia patients—A EuroFlow study

Flowcytometric analysis allows for detailed identification and characterization of large numbers of cells in blood, bone marrow, and other body fluids and tissue samples and therefore contributes to the diagnostics of hematological malignancies. Novel data analysis tools allow for multidimensional analysis and comparison of patient samples with reference databases of normal, reactive, and/or leukemia/lymphoma patient samples. Building such reference databases requires strict quality assessment (QA) procedures. Here, we compiled a dataset and developed a QA methodology of the EuroFlow Acute Myeloid Leukemia (AML) database, based on the eight-color EuroFlow AML panel consisting of six different antibody combinations, including four backbone markers. In total, 1142 AML cases and 42 normal bone marrow samples were included in this analysis. QA was performed on 803 AML cases using multidimensional analysis of backbone markers, as well as tube-specific markers, and data were compared using classical analysis employing median and peak expression values. Validation of the QA procedure was performed by re-analysis of >300 cases and by running an independent cohort of 339 AML cases. Initial evaluation of the final cohort confirmed specific immunophenotypic patterns in AML subgroups; the dataset therefore can reliably be used for more detailed exploration of the immunophenotypic variability of AML. Our data show the potential pitfalls and provide possible solutions for constructing large flowcytometric databases. In addition, the provided approach may facilitate the building of other databases and thereby support the development of novel tools for (semi)automated QA and subsequent data analysis.The EuroFlow Consortium received support from the FP6-2004-LIFESCIHEALTH-5 program of the European Commission (grant LSHB-CT-2006-018708) as a Specific Targeted Research Project (STREP). The EuroFlow Consortium is part of the European Scientific Foundation for Hemato Oncology (ESLHO), a Scientific Working Group (SWG) of the European Hematology Association (EHA). S.M. was supported by Acción Estratégica en Salud (AES) (Grant PI21_01115) and the grant of CIBERONC of the Instituto de Salud Carlos III, Ministerio de Ciencia e Innovación, Madrid, Spain and FONDOS FEDER (no. CB16/12/00400)

Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Quality assessment of a large multi-center flow cytometric dataset of acute myeloid leukemia patients-a EuroFlow study

Simple Summary Flow cytometry allows detailed characterization of large numbers of cells and plays an important role in the diagnosis of acute myeloid leukemia. To facilitate analysis of flowcytometric data, reference databases of normal bone marrow samples and samples from acute myeloid leukemia patients, together with new software tools, are required. We here report on the building of a large database of acute myeloid leukemia patients (n = 1142) and 22 normal samples. We report on the quality assessment procedure used and its validation, discuss potential pitfalls, and provide possible solutions for avoiding such flaws in the construction of other databases. Our data show that obtaining and collecting reproducible flow cytometric data over time and across centers is feasible, but also that strict quality assessment remains crucial, even when standardized protocols for staining and instrument settings are being used in a multicenter setting. Flowcytometric analysis allows for detailed identification and characterization of large numbers of cells in blood, bone marrow, and other body fluids and tissue samples and therefore contributes to the diagnostics of hematological malignancies. Novel data analysis tools allow for multidimensional analysis and comparison of patient samples with reference databases of normal, reactive, and/or leukemia/lymphoma patient samples. Building such reference databases requires strict quality assessment (QA) procedures. Here, we compiled a datas

Quality Assessment of a Large Multi-Center Flow Cytometric Dataset of Acute Myeloid Leukemia Patients—A EuroFlow Study

Flowcytometric analysis allows for detailed identification and characterization of large numbers of cells in blood, bone marrow, and other body fluids and tissue samples and therefore contributes to the diagnostics of hematological malignancies. Novel data analysis tools allow for multidimensional analysis and comparison of patient samples with reference databases of normal, reactive, and/or leukemia/lymphoma patient samples. Building such reference databases requires strict quality assessment (QA) procedures. Here, we compiled a dataset and developed a QA methodology of the EuroFlow Acute Myeloid Leukemia (AML) database, based on the eight-color EuroFlow AML panel consisting of six different antibody combinations, including four backbone markers. In total, 1142 AML cases and 42 normal bone marrow samples were included in this analysis. QA was performed on 803 AML cases using multidimensional analysis of backbone markers, as well as tube-specific markers, and data were compared using classical analysis employing median and peak expression values. Validation of the QA procedure was performed by re-analysis of >300 cases and by running an independent cohort of 339 AML cases. Initial evaluation of the final cohort confirmed specific immunophenotypic patterns in AML subgroups; the dataset therefore can reliably be used for more detailed exploration of the immunophenotypic variability of AML. Our data show the potential pitfalls and provide possible solutions for constructing large flowcytometric databases. In addition, the provided approach may facilitate the building of other databases and thereby support the development of novel tools for (semi)automated QA and subsequent data analysis

Automated identification of leukocyte subsets improves standardization of database-guided expert-supervised diagnostic orientation in acute leukemia: a EuroFlow study

Precise classification of acute leukemia (AL) is crucial for adequate treatment. EuroFlow has previously designed an AL orientation tube (ALOT) to guide toward the relevant classification panel and final diagnosis. In this study, we designed and validated an algorithm for automated (database-supported) gating and identification (AGI tool) of cell subsets within samples stained with ALOT. A reference database of normal peripheral blood (PB,n = 41) and bone marrow (BM;n = 45) samples analyzed with the ALOT was constructed, and served as a reference for the AGI tool to automatically identify normal cells. Populations not unequivocally identified as normal cells were labeled as checks and were classified by an expert. Additional normal BM (n = 25) and PB (n = 43) and leukemic samples (n = 109), analyzed in parallel by experts and the AGI tool, were used to evaluate the AGI tool. Analysis of normal PB and BM samples showed low percentages of checks ( 0.95 for all cell types in PB andr(2) > 0.75 in BM) and resulted in highly concordant classification of leukemic cells by our previously published automated database-guided expert-supervised orientation tool for immunophenotypic diagnosis and classification of acute leukemia (Compass tool)